June 9, 2009 15:31 WSPC/INSTRUCTION FILE QCofClassStringsIJQI 



International Journal of Quantum Information 
© World Scientific Publishing Company 



o\ ■ 
o ' 

o : 

(S) ; ON THE QUANTUM KOLMOGOROV COMPLEXITY OF 

£ ■ CLASSICAL STRINGS 

s : 

i— i ■ 

0> . MARKUS MULLER 

Max Planck Institute for Mathematics in the Sciences, Inselstr. 22, 
^ (— j 04103 Leipzig, Germany, and 

O ■ Institute of Mathematics, TV Berlin, Strafie des 17. Juni 136, 

I ' 10623 Berlin, Germany 

^— 1 i mueller@math.tu-berlin.de 

a ■ 

^ ' Received Day Month Year 

i^j ' Revised Day Month Year 

(N^ ■ We show that classical and quantum Kolmogorov complexity of binary strings agree up 
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■^J- ' (classical resp. quantum) computer program that outputs the corresponding string. 

i It follows that quantum complexity is an extension of classical complexity to the 

• domain of quantum states. This is true even if we allow a small probabilistic error in 

(S^ 1 the quantum computer's output. We outline a mathematical proof of this statement, 

• ' based on an inequality for outputs of quantum operations and a classical program for 

the simulation of a universal quantum computer. 
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1. Introduction 
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' Are quantum computers more powerful than classical ones? Concerning computa- 

tional complexity, i.e. the speed of solving certain problems, the answer seems to 
be yes. A well-known example is Shor's algorithm (cf. Ref. [T]) for factoring large 
integers on quantum computers in polynomial time, which is generally believed to 
be impossible for a classical computer. 

In this paper, we intend to compare classical and quantum computers with 
respect to a different complexity measure, which does not care about the time of 
computation, but instead measures the minimal description length. More in detail, 
let {0, 1}* = {s, 0, 1, 00, 01, . . .} denote the finite binary strings, where e is the empty 
string, and let U be a universal computer. Then, the Kolmogorov complexity of any 
string i£ {0,1}* is defined as 

C(x) := mm{£(p) | U(p) = x}, (1) 

i.e. the length of the shortest computer program that makes U compute and output 
x. Since it was developed in the 1960's by Solomonoff, Kolmogorov and Chaitin, this 
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complexity measure has turned out to have useful applications in several different 
areas of mathematics (as explained e.g. in Ref. [2]), besides being an interesting 
object of study itself. 

Due to the rapid development of quantum information theory, there has been 
some interest in recent years (cf. Refs.EHUO)]) *° ex t en d this quantity to the quantum 
case. While inputs and outputs of classical computers are binary strings, quantum 
computers may also work with superpositions of strings. Thus, it makes sense to 
consider quantum states like, for example, 

|V> = ^= (|01) + |10» 

as inputs and outputs of quantum computers, and to assign a quantum Kolmogorov 
complexity measure QC(\ip)) to those states, by a definition similar to Eq. (TT]). Such 
a definition has first been given by Berthiaume, van Dam, and Laplante in 2001 in 
Ref.H 

Formally, the aforementioned quantum state \ip) is an element of some Hilbert 
space 7i{o,i}» that contains the classical binary strings as an orthonormal basis. 
We do not restrict our considerations to pure states like 1-0), but also allow mixed 
statefl i.e. arbitrary density operators p on 7i{o.i}* as inputs and outputs of quan- 
tum computers. We call these density operators qubit strings. 

Once a quantum analogue of Kolmogorov complexity has been defined, the 
question arises how classical and quantum complexity are related to each other on 
their common domain of definition. In other words, how are C(x) and QC{\x)) 
related for classical binary strings x S {0,1}*? Generically, it might be true that 
quantum computers offer better possibilities to find short (quantum) descriptions 
of binary strings than classical computers. In this case, we would have <5C(|a;)) <C 
C{x) for some strings x. 

Here, we shall show that this is not the case, and that C(x) and QC(\x)) are 
equal up to an additive constant. We prove an analogue of this result also for the 
case that a certain probabilistic error is allowed for the quantum computer's output 
(corresponding to the complexity notion QC 5 introduced below in Section [2|). Our 
result answers an open problem posed in Ref. SI 

Note that if \ip) is a non-classical qubit string, then the classical complexity 
C(\ip}) is undefined, because \ip) is not a classical binary string. However, if we 
define C(\ip)) to be the shortest classical description of \ip), then C and QC behave 
completely differently: For example, if 

IV) := Vfi\o) + VT~~n\i), 

where < f2 < 1 denotes the (non-computable) halting probability of a universal 
Turing machine (cf. Ref. [2]), then \ip) is a quantum description of itself (with a length 
of one qubit), whereas \ip) does not even possess a finite classical description (i.e. 

a It is natural to allow mixed states also, because prefixes of (pure) qubit strings can be mixed, as 
explained in Ref. \E\ 
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computer program to compute \ip})- Even an approximate description must contain 
a large number of bits, as SI is a random real number. Hence QC(\4>)) <C C(\ip)). 
Thus, the result in this paper does not imply that C and QC are just the same; 
they only agree on the domain of classical strings. 

We remark that the exposition in this paper focuses more on a compact presen- 
tation than on mathematical rigidity. For more mathematical details of the proof, 
we refer the reader instead to Ref. [7] 

2. Quantum Kolmogorov Complexity 

We would like to define the quantum complexity of some qubit string p as the length 
of the shortest quantum computer program that produces p. But while classical 
strings are discrete objects, the set of qubit strings is a continuum. If two qubit 
strings are close to each other, they are very difficult to distinguish by means of any 
quantum measurement. Thus, it does not make sense to demand that the desired 
output p is produced perfectly by the computer program, but it is more useful to 
allow a certain error tolerance. 

To quantify the difference between two qubit strings, it is natural to use the 
trace distance (see Ref. [J), which is defined as \\p — (t\\tt '■= |Tr|/> — aj. 

Quantum Kolmogorov complexity can now be defined in essentially two ways: 
First, one can just fix some error tolerance S > 0. Second, one can demand that 
the quantum computer outputs the qubit string p as accurately as one wants, by 
supplying the machine with a second parameter as input that represents the desired 
accuracy. We consider both approaches and follow the lines of Berthiaume et al. 
(Ref. [3]) except for slight modifications: 

Definition 1 (Quantum Kolmogorov Complexity). Let U be a universal 
quantum computer and S > 0. Then, for every qubit string p, we define 



The universal quantum Turing machine (QTM), constructed in Ref. [5] and mod- 
ified for the definition of Kolmogorov complexity with respect to base length in 
Ref. can serve as a model for a universal quantum computer. 

The length 1(a) of a qubit string a is here defined as the maximal length of 
any classical string that has non-zero overlap with a. For example, the qubit string 
\ip) := ||00) — ||1011) (or rather its corresponding density operator is 
understood to have length £(\ip}) = 4. This is called the "base length" by Bostrom 
and Felbinger in Ref. ITUl 

Quantum Kolmogorov complexity shares many properties with its classical 
counterpart. For example, there is a constant c G N such that for every qubit 
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QC\ P ) := mm{l{a) | \\p- t/(a)|b < 6}. 



Moreover, we set 
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string p, it holds QC(p) < £(p) + c (the same for QC ), and the value of QC(p) 
depends on the choice of the universal quantum computer U only up to an additive 
constant as shown in Ref. [9l 



3. Quantum Kolmogorov Complexity of Classical Strings 

The main result of this paper is the following theorem: 

Theorem 1 (Main Theorem). For every classical string x £ {0, 1}*, 

C(x) = QC(\x)) + 0(l), (2) 

i.e. the absolute value of the difference of C and QC is bounded by a constant on 
the domain of classical strings. Moreover, for every rational < S < there are 
constants eg, c' s £ N such that 

QC s (\x)) < C(x) + c s < Q °J^ + c' s . 

Thus, the only possible difference between classical and quantum complexity 
for classical strings is the factor > 1 in the second equation, indicating that 

a quantum computer with large error tolerance 8 might sometimes have shorter 
programs for generating classical strings than a classical computer (which always 
has error tolerance zero). 

Note that in a very interesting paper based on a different complexity notion 
(Ref. 5), Gacs has already shown a prefix- free analogue of Eq. @. 



3.1. Outline of the Proof of Theorem[l\ 

We start with a simple argument, showing that for every rational number 6 > 0, 
there is a constant feeN such that 

QC s (p) < QC(p) + k s 

for every qubit string p: This is clear, since every (quantum) program that computes 
p to any desired accuracy can be transformed into a program that computes p within 
some fixed accuracy S. We just have to additionally specify the parameter 5, which 
costs at most a fixed number of bits kg- 

Also, we claim that there is some constant c £ N such that for every classical 
string x, it holds 

QC{\x)) < C(x)+c. 

This can be seen as follows: As Bennett has shown in Ref. [TTJ we can choose the 
classical computer which is used in the definition of C{x) to be reversible. But every 
reversibe computer is also a (special case of a) quantum computer and can thus be 
simulated by our universal quantum computer U . We can thus find a program for 
U which computes x perfectly, and we only have to add a constant number of bits 
for the simulation. 
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On the Quantum Kolmogorov Complexity of Classical Strings 5 



It remains to show that there is some constant k$ £ N such that 



C(x) < 



1 



QC s (\x)) + kl 



(3) 



1-46 



We prove this inequality by giving a classical computer program p that simulates the 
universal quantum computer C/[3 More in detail, on input i, n s N and < 6 € Q, 
that program approximately computes the z-th classical string that is generated 
within some accuracy 6 by the quantum computer U on any input qubit string of 
length n. It works as follows: 

1. Set the time t :— and the counter c := 0. 

2. Compute a discretization of the set of qubit strings (density matrices) 
of length less than or equal to n, that is, the description of a finite set 
{(Ti, . . . , 0a/} of qubit strings such that for every qubit string a of length 
at most n, there is some j 6 {1, . . . , M} such that a is very close to <jj in 
trace distance. 

3. For every j G {1,...,M}, simulate the quantum computer U on input 
<7,j for t time steps and decide whether U approximately halts on input 

at time t. If this is the case, then compute a good approximation of 
the corresponding output, and check for every classical string x of length 
l(x) < t whether that output is very close to \x) (with a suitable distance 
threshold depending on S) . If such a string x is found, increase the counter 
by one, i.e. c := c + 1, and check if c — i. If this is true, then output x and 
halt. 

4. Increase the time t by one, i.e. t := t + 1, and go back to step 3. 

If every approximation in every step is done in appropriate accuracy, then this 
program will find every classical string x which is generated by some input qubit 
string a of length 1(a) = n within accuracy <5, whenever the corresponding index 
i is given as input. But then, we can construct a classical computer program p x 
to produce x: We just have to append a description of the program above to a 
description of the integer i. The resulting program p x will have length 



where N n> s denotes an upper bound on the possible values of i (given n and 5), i.e. 
i < N n j, and k' s is a constant that depends on i5 (since a description of <5 has to be 
included in the program). 

As long as the string x satisfies QC s (\x)) < n, the program p x must terminate 
and return output x, which can be seen as follows. If QC s (\x)) < n, then there 
exists an input qubit string a such that U(a) is (5-close in trace distance to |a;)(x|, 

b Note that there is no problem in simulating a quantum computer (e.g. a QTM) on a classical 
computer, if a classical description of that QTM and of the input qubit string is given. The 
simulation will be very inefficient, i.e. very slow, but the time of computation is irrelevant for 
Kolmogorov complexity. 



£(Px) = k' s + riog 2 A^ n , 5 
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and there is a corresponding halting time r. If the counter t in the four-step program 
given above is large enough, it will reach r and finally discover the corresponding 
output string x. 

To get a useful number of bits [~log 2 N nj s] to encode the value of i, we have 
to estimate the total number N Ui s of classical strings that are produced by the 
quantum computer U on some input of length less than or equal to n, if some error 
tolerance S is allowed. (Since it may be hard to compute the actual value of N ni $, 
we do not use N ni g = N ni $ directly; we only have to ensure that N ni $ > N ni $). 
Viewed as qubit strings, the classical strings are mutually orthogonal. Moreover, it 
has been shown in Ref.[T2]that the quantum computer U as a mapping on the qubit 
strings is a quantum operation, as every physically realizable operation on quantum 
states (cf. Ref.Q]). Thus, we have an instance of a more general problem: Given some 
quantum operation on some Hilbert space, how many mutually orthogonal vectors 
can be created by that operation if some error S is allowed? We give an estimate 
below in Lemma [TJ Using the result of that lemma, we get a constant kg 1 £ N such 
that 



- n + l + 4^1og 2 | 
log 2 N„ tS < Y^4~5 



1-45 



since the qubit strings of length n or less are density matrices on the Hilbert space 7i 
which is spanned by the classical strings of length less than or equal to n, and thus 
d := dim7Y = 2 ,l+1 — 1. Thus, it is possible to choose the fixed value log 2 N n< s ■= 
+ kg' as the number of bits that are used in the description of p x to specify 
the corresponding index i. The program p x will then have length 



t(p x ) = K 



l- AS 



In particular, the value of n can be deduced from the length of p x . This is the reason 
why we do not have to implement an additional description of n in the program p x 
(which would add an additional number of about log n bits) . Instead, the program 
p x may compute n from its own length, more in detail, from the length of the 
description of i@ 

We get a bound on the classical Kolmogorov complexity of x via 

C(x)<£( Px )<k' s >+ I ^- s , (4) 

where k' s ' := k' s + k'g + 1. The desired inequality ^ now follows from the special 
case n :— QC s (\x)) (we have only used ">" in the calculation above). 



c The part of p x which does not contain the description of i might be encoded, for example, in 
some self-delimiting manner, e.g. by means of a prefix-free code, such that it becomes clear at 
what bit position the description of i starts. The description of i, however, does not need to be 
self-delimiting, since programs may always determine their own lengths: in the Turing-machine 
picture, they may look for the first blank symbol on the tape, for example. 
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On the Quantum Kolmogorov Complexity of Classical Strings 7 

Finally, it remains to prove that 

C(x) <QC(\x))+c. (5) 

We start by bounding the number N of classical strings s with quantum Kolmogorov 
complexity QC(\s)) < n. First notice that if k e N is fixed, then the map a i— » 
U(cr,k) is a quantum operation (cf. Ref. 7). Thus, if we define 

Si n) := |a G {0, 1}* | 3a : t(a) < n, \\U(a, k) - | S )( S || Tr < ± 

then it follows from Lemma [1] that the cardinality of these sets is bounded by 

log 2 #S*^< — *j . (6) 

1 k 

Consequently, if a classical string x has quantum Kolmogorov complexity QC(\x)) < 
n, then it must be an element of for every k, i.e. x € HfceN ( c ^- ^ ne definition 
of QC in Definition [1]) . Hence the number TV of such strings is bounded by 

r„\ n + 1 + t log, k , , 

log, TV < log inf #S , J ( ™ ) < inf k , 62 = n + 1. 7 

It also follows from inequality © that there is some K € N (possibly depending 
on n) such that #5'[" ) < 2 n+1 + 1 for every fc > iT. Since cardinalities are integer- 
valued, this means that #S'^ ) < 2" +1 for every k > K. 

In the proof of inequality ((3| , we have given a classical computer program p x 
that approximate!^! computes the i-th classical binary string x that is generated 
by some quantum computer program of length less than n up to trace distance S. 
We modify this program to obtain a new program p x , containing an integer i € N, 
which works as follows: 

1. Set 5 := i. 

6 

2. Approximately compute the list of all classical strings s that are generated 
by any quantum computer program of length less than or equal to n up to 
trace distance 5. 

3. If this list contains more than 2 ,i+1 items, then let S := | and go back to 
step 2. 

4. Output the i-th element of this list. 

This program always terminates: if S is small enough, then k := [I] > K holds, 
and the set Su^ contains at most 2™ +1 elements, which interrupts the loop in step 
3. Due to the calculations above, every classical string x with QC(\x)) < n is 
output by this computer program p if i is chosen appropriately. Moreover, it holds 
i < N < 2 n+1 due to inequality 0, such that it is possible to encode i in n + 1 

d Note that we do not take into account here all the possible numerical errors that the program has 
to deal with. See Ref. [7| for a more detailed (hence much more complicated) discussion concerning 
how to choose the accuracies in the approximations and numerical computations. 
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bits. In contrast to the program p x , this program p x does not need any specific 
parameter S as input. Moreover, it will also compute n directly from its own length 
similarly as explained above for the program p x . It follows that there is a constant 
d S N (and c := d + 1) such that 

C(x) < £(p x ) = c +n + l = n + c. 

This proves inequality ([5]). Combining all the previous inequalities completes the 
proof of the theorem. □ 

4. An Inequality for the Almost-Output Dimension of Quantum 
Operations 

Here is an analytical result that we have used above to estimate the number of clas- 
sical outputs. Note that a special case of this lemma has been published in Ref. [P2l 
For 5 — 0, setting 01og| := 0, that lemma states that quantum operations cannot 
increase the number of dimensions, which is obvious, since quantum operations are 
linear maps. For small 6 > 0, the number of orthonormal vectors can increase only 
slightly. 

To state our result, we use the trace norm ||p — cIItt := ^Tr|p — a\, which is used 
also in Ref. [TJ It is easy to translate the result to the 1-norm, since || • ||ti- = ^| ■ Ki- 
ln the field of classical Kolmorogov complexity, a "counting argument" is frequently 
used, stating that N different inputs for a computer can have at most N different 
outputs. Since our lemma is some kind of quantum generalization of this result, we 
call it a "quantum counting argument" . 

The proof is based on Holevo's x _c l uan tity associated to any ensemble E p := 
{X i ,p i } i , consisting of probabilities < Aj < 1, J^j A* = 1, and of density matrices 
Pi acting on a Hilbert space 7i. Setting p := J^i^iPi? the x-quantity is defined as 
follows: 

X(E P ) := S(p) - KS(pi) = Y ^S{pup), 

i i 

where S(-, ■) denotes the relative entropy. 

Lemma 1 (Quantum Counting Argument). LetTt andTt' be separable Hilbert 
spaces with < d := dimH < 00, and let < 5 < j-. If £ is a quantum operation 
from the density operators ofTL to those ofTL' , then the maximal number N of mu- 
tually orthonormal vectors on TL 1 which are all produced by £ within trace distance 
5 on some (possibly mixed) input is bounded by 

log 2 d + 4(51og 2 I 

lo&iV - —6 ■ 

Proof. For 6 = 0, the assertion of the theorem is trivial (setting, as usual, 
Ologi := 0), so assume S > 0. Let N$ be a set of orthonormal vectors G TL 1 
such that there exists some input density operator a on TL with 

\\£{a)-\^)^\\\<8. 
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On the Quantum Kolmogorov Complexity of Classical Strings 9 

We may also assume that N$ ^ 0. Let N$ =: • ■ ■ , \<Pn)}- Our task is to 

upper-bound the number of vectors N. By definition, there exist density operators 
Gi on Tt such that \\£ {g{) — \<fii){ip%\ ||ti- < S. For 1 < i < N, define the projectors 
Pi := \(pi)((pi\, and set Pjv+i := 1—Ya=i \<Pi){<Pi\- Let {l^)}fe=i W ' be an orthonormal 
basis of H'. Now we define a quantum operation Q from the trace-class operators 
on Ti' to those on C N+1 via 

N+l dimW' 

2(«)-E E K)(fc|i^|fc)(e 4 |, 

where { l e i)}^Ji 1 denotes an arbitrary orthonormal basis of C N+1 . It is clear that Q 
is completely positive (Kraus representation), and one easily checks that Q is also 
trace-preserving. This is also true if dim7i' = oo; then, the corresponding infinite 
series is absolutely convergent in || • ||iT-norm, and inherits complete positivity from 
its partial sums. Moreover, for 1 < j < iV, we have 

Q(Pi)= y E\es)(MPi\*>)(e j \=\ej)(ei\- 

k 

Consider the equidistributed ensemble E CT := and let g := 

■ir Yli=i °i- -Due to the monotonicity of relative entropy with respect to quantum 
operations, we have 

JV N 

x (Q ° = ^ E s (2 ° E ^ 2 ° E ^)) ^ E s (°*> °) 

i=l i=l 

= *(E CT ) <logd- 

The trace distance is also monotone with respect to quantum operations as ex- 
plained in Ref. 1, Thus, for every 1 < i < N, 

\\Q°£(<Ti) - Q(P)\\ T r < - PlWr = \\£(<Ti) ~ I^X^HlTr < 5. 

Let now A := i ^ti Q(P) = W Z^Li l e *X e il> then S ( A ) = lo S^» and 

1 N 

|| Q o £(g) - A|| Tr < - £ II Q ° - 2(^)11^ < 

8=1 

Now we use the Fannes inequality as given in Ref. CD It states© that for density 
matrices p and g with trace distance ||p — cr 1 1 Tr _■ it holds 

|S(p) - S{g)\ < 2\\p- G\\Trlogd + r)(2 ■ \\p- g\\tt), 

where d is the dimension of the Hilbcrt space and rj{x) — — xlogx > 0. In our case, 
this inequality yields 

S (2 o £{Gi)) = \S(Qo£(g 1 ))~S(Q(P 1 )) \ <2Slog(N + l)+ v (2d), 
\S(Qo£(g))-S{A)\ <2S\og(N + 1) + v (2S). 

e Note that the notation in Ref. [T| differs from the notation in this paper: it holds T(p, cr) = 
Tr|p - a\ = \\p - a\\i = 2 ■ \\p - o\\ti- 
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Altogether, we get 

1 N 

logd> X (Qo£(E a ))=S(Qo£(a))--J2s(Qo£(a l )) 

i=l 
1 N 

> S(A) - 2S\og(N + 1) - V (26) - - ]T (25\og(N + 1) + V (25)) 

i=l 

= log TV - 4(51og(iV + 1) - 2r7(2(5) 

> (l-4(5)logA-4(51og2 + 4(51og(2(5), 

where we have used the inequality log(iV + 1) < log Y + log 2 for N > 1. The claim 
follows by rearranging. □ 

5. Conclusion 

We have shown in this paper that classical and quantum Kolmogorov complexity 
agree for classical strings up to an additive constant. In some sense, quantum com- 
puters are no more powerful in describing classical strings than classical computers. 

Yet, there is another, more positive way to state the result: This also means 
that quantum complexity is an extension of classical complexity to the domain of 
quantum states, similar to the way that von Neumann entropy extends classical 
Shannon entropy. Thus, every result on quantum complexity will contain some 
classical result as a special case. Moreover, this allows to treat both classical and 
quantum complexity in a single mathematical framework. 
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